DOCUMENT RESUME 



ED 360 291 



SP 034 651 



AUTHOR 
TITLE 

PUB DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



Williams, Susan E. 

Effect of Teacher Involvement in Implementation of an 

Innovation* 

14 Apr 93 

lip.; Paper presented at the Annual Meeting of the 
American Educational Research Association (Atlanta, 
GA, April 12-16, 1993). 

Speeches/Conference Papers (150) — Reports - 
Research/Technical (143) 

MF01/PC01 Plus Postage. 

'''Calculators ; ^Curriculum Development; Educational 
Innovation; Junior High Schools; Vc Mathematics 
Curriculum; Middle Schools; Secondary School 
Mathematics; Secondary School Teachers; *Teacher 
Attitudes; *Teacher Participation 



ABSTRACT 

This study investigated the effect of teacher 
involvement in the development of calculator mathematics curriculum 
on the implementation of calculators in the classroom. Forty-five 
middle school mathematics teachers served as subjects. Findings 
revealed that teachers involved in curriculum development were 
observed significantly more often than those not involved in 
curriculum development to: explain the relationship between 
calculator and paper-and-penci 1 algorithm, stress the use of the 
calculator as a "time-saver , " stress use of the calculator as a 
problem-solving tool, and initiate use of calculators in the 
classroom. Neither teacher attitude nor teacher involvement affected 
the overall quantity of student calculator use. In classrooms of 
teachers who were involved in curriculum development, students were 
observed more often than students in classes of other teachers to use 
calculators for exploration and induction activities, solving routine 
word problems, and self-checking and verifying answers. Findings 
indicate that classroom calculator implementation differences are not 
primarily the result of teacher attitude toward calculators. 
(Contains 17 references.) (JDD) 
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Effect of Teacher Involvement 
in Implementation of an Innovation 



Futrell (1988) noted that the teacher is the actual implemented of classroom change. Successful 
classroom innovation is dependent upon teacher support and commitment (Crandall, 1983). 
Several researchers have examined curriculum development and implementation and found that 
innovations may produce disappointing outcomes, not because of inadequacies of the innov ative 
idea, but because of lack of teacher involvement in the development of the innovation (Berman & 
McLaughlin, 1976; Stein & Wang, 1988; Strathe & Hatcher, 1986). Fullan (1972) concluded that 
the teacher must experience some sense of meaning, practicality, and ownership early in the change 
process for implementation to gain momentum; otherwise teachers will abandon the efforts and the 
implementation will fail. 

Participation in the development of curriculum offers teachers a role in shaping educational 
programs, a sense of involvement and responsibility in the implementation process, and a 
commitment to the success of the program (Morin, 1986; Rothman, 1988; Young, 1985). Berman 
and McLaughlin ( 1975) found that any lasting effect of change seemed related to the process of 
curriculum development rather than to the relative quality of materials developed. Authoritarian 
decision-makers can mandate "cosmetic" short-term changes, but participative structures are 
needed to promote lasting change (Fullan, 1982). 

Reviews of educational reform involving technology provide scant evidence that curriculum 
and instructional transformations have occurred as a result of the availability of technology (Dedc, 
1990). The incorporation of technology into mathematics teaching, however, could play a 
powerful role in educational reform because technology could serve both as a catalyst for change 
and as a resource that could facilitate the transformation of teaching and learning (David, 1990). 
Effective methods for creating educational reform, particularly those involving technology, need to 
be determined and documented. 

Once an innovation is adopted and in use, interest tends to shift toward the monitoring of 
outcomes. Evaluations of innovations often focus on student learning outcomes and omit an 
evaluation of the process of change, of the teachers' implementation behavior, and of the degree of 
implementation. Although student outcomes may be considered the ultimate indicator of the 
effectiveness of an innovation, use of such measurements are both premature and inappropriate 
without an examination of how the innovation was implemented (Berman & McLaughlin, 1976). 
Research summarized by Loucks-Horsley and Hergert ( 1985) indicates that it takes between three 
and five years for the change process to become totally incorporated into a teacher's instructional 
approach. Hence, sufficient time must be allowed for an innovation to be developed and 
incorporated and tested in "pieces" before an accurate assessment of its long-term effects on 
students can be determined (Ornstein & Hunkins, 1988). By examining the implementation 
process, one can determine whether and to what degree change has occurred. 

Statement of Problem 

No study to date has investigated whether involvement in curriculum development 
makes a difference when the innovation involves technology in addition to new 
instructional approaches. The purpose of the present study was to investigate the effect of 
teacher involvement in the development of calculator mathematics curriculum on the 
implementation of calculators in the classroom. The independent variable studied was level 
of teacher involvement in the development of new calculator materials while accounting for 
teachers' initial attitudes toward calculators. The dependent variables for the study included 
(a) teacher instruction with calculators, (b) frequency of student use of calculators, and (c) 
types of student activities which involved calculator use. Of particular interest, was 
whether teacher attitude toward calculators would be the overriding factor which affects the 
implementation process, or if other factors (i.e., teacher involvement in curriculum 
development) would also play important roles. 
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Methods 

Subjects were selected from a large, urban/suburban school district that is located in a 
major metropolitan city in the south central region of the United States. Currently, the school 
district in conjunction with a leading university is involved in a three-year nationally funded 
mathematics project to create a model calculator curriculum for grades 6-8. During the first month 
of the project, each of the 60 middle school teachers received a minimum of 12 hours of inservicc 
training on the use of calculators. Three months later, each of their middle school students 
(approximately 7,000 total in the district) was issued a calculator. 

The selection of the subjects (45 middle school mathematics teachers) for this quasi- 
experimental study was based upon the teachers' scores on the Calculator Teachers Attitudes Scale 
(Bitter, 1980). It was anticipated that teachers' attitudes toward calculators might affect the 
implementation process. Hence, controls for teacher attitude were added to the research design so 
that differences (based on level of involvement in curriculum development) amon w groups might be 
examined. The investigation compared the implementation process of three groups: (a) teachers 
who had high attitudes toward calculators and were actively involved in the development of a 
calculator mathematics curriculum (group 1), (b) teachers who had high attitudes toward 
calculators, used calculators in their classroom, had access to the materials being developed, but 
were not actively involved in development of the curriculum (group 2), and (c) teachers who had 
low attitudes toward calculators, used calculators in their classroom, had access to the materials 
being developed, but were not actively involved in development of the curriculum (group 3). (No 
writers were found to have low attitudes toward calculators.) 

The curriculum development group met for three hours each month from September through 
May with a university educator to create calculator activities for the mathematics curriculum. The 
writing meetings consisted of discussions about the technology, the NCTM Curriculum and 
Evaluation Standards , reports and goals set by national groups, calculator research results, 
questioning and problem-solving strategics, topics which need to be deleted or de-emphasized in 
the mathematics curriculum, new roles for classroom teachers, and suggestions for improving 
newly developed activities. 

During the spring semester, the 60 teachers (including the 45 teachers for this study) 
were each observed four times by trained classroom observers. Observers were blind to 
the research questions, and the teachers had no indication as to when they would be 
observed. The observation Rating Scale for Calculator Implementation (ORSCI) 
(Williams, Waxman, & Copley, 1991) was used to assess the quantity and quality of 
calculator use for each of the three groups. The observation data was analyzed at the 
teacher level and then used to derive group means for each indicator. Analyses of variance 
were used to compare the three groups of teachers (while accounting for teacher initial 
attitude toward calculators) on the high-inference indicators. It was expected that teacher 
attitude toward calculators could affect the implementation process and the frequency of 
calculator use in classrooms. Hence, teacher attitude toward calculators was used as a 
controlling variable. 

Data Sources 

Teachers' initial attitudes toward calculators were measured using the Calculator Teacher 
Attitudes Scale (Bitter, 1980). The scores were used to separate the teachers into high attitude and 
low attitude groups. The 15 lowest scores identified the teachers for group 3. The five department 
chairpersons were eliminated because of their exceptionally high initial calculator attitude scores 
and strong leadership qualities. This was done to eliminate a possible bias factor for the group 
comparisons. The attitude scores for group 1 and 2 lay within the same range. 

The Observation Rating Scale for Calculator Implementation (ORSCI) (Williams, Waxman, & 
Copley, 1990) was used to measure the amount of calculator use in each classroom, to assess the 
quality of the calculator instruction, and to identify the kinds of activities in which students were 
involved when they used calculators. Seventeen indicators measure the quantity and quality of 
calculator instruction and use. Observation data was analyzed at the teacher level. Group mean 
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scale scores for each indicator from the high-inference classroom observation schedules w ere 
derived, Analyses of variance were used to compare the three groups of teachers (while 
controlling for teacher initial attitude toward calculators). 

Results and Conclusions 

The attitude scores for the 45 teachers selected for the study ranged between 58 and 
97. Fifteen scores on the Calculator Teacher Attitudes Scale were less than or equal to 80. 
These 15 teachers were all non-writers and were identified as the low attitude toward 
calculators group (Group 3), (None of the 24 members of the writing team scored an 80 or 
below.) The remaining 30 teachers selected for the study (one-half writers and one-half 
non-writers) scored above 80. They were identified as having high attitudes toward 
calculators and assigned to the appropriate group; 15 writers, high attitude toward 
calculators group (Group 1) and 15 non-writers, high attitude toward calculators group 
(Group 2). The range of the scores on the Calculator Teacher Attitudes Scale and the mean 
score for each group were as follows: Group 1, range 81-96, mean 87.47; Group 2, range 
82-97, mean 87.93; Group 3, range 58-80, mean 70.47. Listed in Table 1 are the score 
frequencies and percents for each group. 

Once the three groups were identified, group means for the overall score and for each 
of the 20 items were determined. One-way analyses of variance were used to compare the 
three groups of teachers on the overall score and on each of the 20 items from the 
Calculator Teacher Attitudes Scale. Due to the large number of comparisons tested, the 
level of significance chosen for this portion of the study was 0.01. Significant differences 
among groups were found for the overall score and for 13 of the 20 items. In each of these 
14 cases, no significant differences were identified between Groups 1 and 2 (high attitude 
groups), but Groups 1 and 2 scored significantly higher than Group 3 (low attitude group) 
on positive items or significantly lower than Group 3 on negative items. Large standard 
deviations for several of the items indicated that there are several issues regarding calculator 
use which are still unresolved for teachers. The items in question include: (a) students 
shouldn't use calculators while taking math tests, (b) calculators will cause students to not 
learn basic computation skills, (c) calculators should be available for students in all grades, 
(d) calculator use is causing students to lose the chance to do mental computations in 
school, and (e) calculators do not allow students to do simple math on paper. Listed in 
Table 2 is a summary of the findings which includes group means and standard deviations 
for each item, F and p values from each ANOVA, and post hoc results. 

Nine indicators from the Observation Rating Scale for Calculator Implementation 
(ORSCI) (Williams, Waxman, & Copley, 1990) were used to assess classroom instruction 
with calculators for each of the 45 teachers. The group mean scores of the nine classroom 
instruction indicators were analyzed using one-way analyses of variance. Overall, four of 
the nine findings revealed significant differences among the three groups of teachers. 
Teachers involved in curriculum development were observed significantly more often than 
those teachers not involved in curriculum development to (a) explain the relationship 
between calculator and paper-and-pencil algorithm, (b) stress use of the calculator as a 
"time-saver", (c) stress use of the calculator as a "problem-solving" tool, and (d) initiate 
use of calculators in the classroom. No significant differences between the two non- 
writing groups were found. These findings indicate that classroom calculator 
implementation differences are not primarily the result of teacher attitude toward 
calculators. Table 3 which summarizes these findings includes group means for each 
indicator, F and p values from each ANOVA, and post hoc results from Duncan's Multiple 
Range Test when significant differences were found. 

Although each middle school student was issued a calculator, there was no guarantee 
that students would bring the calculators to class each day nor that the teachers would 
provide opportunities for the students to use them. Two indicators were used to estimate/ 
the amount of calculator use in the classroom for each of the 45 teachers. Neither finding 
revealed significant differences among the three groups of teachers. Students of Group 1 
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teachers were observed with their calculators in class approximately 75% of the time; 61 % 
for Group 2 and 63% for Group 3. Calculators were observed in use in Group 1 classes 
nearly 50% of the time; Groups 2 and 3 nearly 40% of the time. For these three groups, 
within the school context of issuing calculators to all students, it appears that neither teacher 
attitude nor teacher involvement affect the quantity of student calculator use. The findings 
are summarized in Table 4 which includes group means for each indicator and F and p 
values from both ANOVAs. 

Six indicators were used to identify types of calculator activities that were employed in 
classrooms for each of the 45 teachers. The group mean scores of the six classroom 
calculator activity indicators were analyzed using one-way analyses of variance. One-half 
of the findings revealed significant differences among the three groups. In classrooms of 
teachers who were involved in curriculum development (Group 1), students were observed 
significantly more often than those in classes of teachers not involved in cuniculum 
development (Groups 2 and 3)to use calculators for (a) exploration and induction activities, 
(b) solving routine word problems, and (c) self-checking and verifying answers. No 
significant differences between the two non-writing groups (Groups 2 and 3) were found 
for any of the six indicators. These findings indicate that active teacher participation in 
curriculum reform involving technology rather than teacher attitude toward calculators may 
be a more significant factor affecting teacher selection of student activities. Table 5 which 
summarizes these findings includes group means for each indicator, F and p values from 
each ANOVA, and post hoc results from Duncan's Multiple Range Test when significant 
differences were found. 

Educational Significance of Study 

The public's concerns about the effects of calculator use in schools has forced researchers to 
direct their attention toward student outcomes. It was necessary for them to show that calculator 
use would not negatively affect student achievement. It is possible, however, that the ensuing 
emphasis on the calculator as the change agent rather than an emphasis on curriculum and 
instructional changes needed when technology is present has slowed the process of change. 

The present study has investigated a piece of the change process and has determined 
that teacher involvement in curriculum development and implementation of an innovation 
(even more than a positive attitude toward the innovative tool) can affect certain aspects of 
teacher instruction with calculators, frequency of student use of calculators, and types of 
activities students engage in when calculators are present. More than the purchase of 
technology and two-day workshops on the operation of the tool are needed for successful 
incorporation of technology into a mathematics curriculum. The importance of teacher 
involvement in curriculum development must be recognized and incorporated into calculator 
reform movements. 
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Table 1 

Frequency Distribution of Attitude Scores bv Groups 





Group I 


Group 2 


Group 3 




writers 


non-writers 


non-writers 




high attitude 


high attitude 


low attitude 




(n c IS) 


<n = 15) 


(n = 15) 


Score 


f % 


f % 


f % 



58 
63 
64 
65 
70 
72 
75 
76 
78 
80 



8J 


2 


13.3 






82 


1 


6.7 




13.3 


83 


1 


6.7 


I 


6.7 


84 






1 


6.7 


85 




13.3 


2 


13.3 


87 






2 


13.3 


88 


3 


20.0 


I 


6.7 


89 


1 


6.7 


1 


6.7 


90 


n 


13.3 






91 






i 


13.3 


92 


J 


6.7 






93 






1 


6.7 


94 


1 


6.7 






95 






1 


6.7 


96 


1 


6.7 






97 






1 


6.7 



1 


6.7 




13.3 


T 


6.7 


1 


6.7 


3 


20,0 


1 


6.7 




13.3 


I 


6,7 


2 


13.3 


I 


6.7 



Table 3 

Summary of Onc-Wnv ANOVAs on CInssroom Instruction with Calculators 





Group 1 
n = 15 


Group 2 
n = 15 


Groti 
n sr 


P 3 
15 






Duncan 


Item 


M 


SI) 


M 


SI) 


M 


SI) 


F 


P 


Post Hoc 


Teacher allows students to deter- 
mine appropriate u*c of calculator. 


.47 


.2! 


.37 


.21 


.30 




2.37 


.105 




1 cachcr cmphasi7.es impor tancc of 
estimation to determine reasonable- 
ness of calculator answer. 


.13 


.21 


.03 


.09 


.05 


10 


2.09 


.137 




Teacher csplains relationship 
bcturcn calculator and pnpcr-arKJ- 
pencil itlgohihm. 


.25 


.16 


.07 


.11 


.07 


n 


9.52 


.000 


1>2.3 


1 racher stresses use of calculator 
a* a 'lime-saver*. 


.25 


.16 


.13 


.13 


.12 


ifi 


3.44 


.(Ml 


l>2.3 


Teacher stresses use of calctilaloi 
as a "pmbl cm -solving tool" 




.Ifi 


.10 


.13 


.07 


) i 


5.10 


.010 


l>2.3 


*! cat'her demonstrates use of 
calculator. 


.27 


.24 


.13 


.10 


.12 


Ifi 


2. 58 


.088 




Student* use caculators during 
teacher demonstration. 


.28 


.28 


.20 


.17 


.15 


18 


1.44 


.248 




Students i n* li Ate use of calculator. 


.35 


.If, 


.30 


.20 


.30 


17 


0.28 


.760 




Teacher inttintes us* of calculator;. 


.45 


.24 


.27 


.2* 


.23 


18 


4.00 


.02fi 


l>2.3 



Hole, df for all items s 2. 42 
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Tabic 2 

Summary of One-Way ANOVAs on Teachers Attitudes Toward Calculators 



Group 1 Group 2 Group 3 

n =15 n = 15 Duncan 



Item 


M 


SD 


M 


SD 


M 


SI) 


F 


P 


Post Hoc 


Calculators should be an integral 
port of the curriculum. 


4.5 


.64 


4.9 


.35 


3.7 


.72 


15.89 


.000 


1,2>3 


1 pel no satisfaction from using 
calculators. 


1.2 


.41 


1.4 


.63 


2.1 


.46 


il.87 


.000 


1,2>3 


1 want calculators for all students. 


4.9 


.26 


5.0 


.00 


4.1 


.80 


17.31 


.000 


1 ,2>3 


Calculators arc loo expensive for 
classroom use. 


I .D 


R - } 


i i 




2. 1 


.92 


6.88 


.003 


1,2>3 


Calculators arc neat. 


A *7 


.o_ 


A 7 


.46 


3.8 


.68 


1 1 .65 


.000 


1.2>3 


Tli/- ncr» f-*f filrMilnlnrc fnr OMnir<i 

and fun should be encouraged. 


4.8 


.41 


4.8 


.41 


3.6 


1.12 


13.50 


.000 


1 ,2>3 


oMiucnis snouiiin i use c«iiLuitmui» 
while taking math tests. 


2.3 


1.40 


2.1 


1.33 


3.2 


1.08 


3.15 


.053 




Mv appreciation for calculators has 
pi own from understanding their 
application to school curriculum. 


4.4 


.83 


4.6 


.51 


3.6 


.83 


7.74 


.001 


l,2>3 


I have never liked calculators. 


1.1 


.35 


1.3 


1.03 


1.8 


.56 


3.72 


.033 




Working with calculators is fun. 


4.0 


C 1 


A f\ 
*t .O 




R 


41 


1 1.59 


.000 


1,2>3 


1 am afraid to work with calculators 
or to use them with students. 


'1.4 


—J A 

.74 


1 .0 




0 A 


i n& 
1 . wo 


S 7R 


.008 


1 ,2>3 


Calculators will cause students to 
not lcam basic computation skills. 


2.2 


1.21 


1.9 


1 .22 


3.1 


1.03 


3.93 


.027 




Calculators should be available for 
students in ail grades. 


A 5 
•4.-3 


1 V\fs 


A f\ 
H .O 


.iij 




I . 1 o 


1 1 7S 


ooo 




I don't feci calculators should be 
allowed in the schools. 


1 . 1 




1 . J- 


A 1 


1 0 


Si 


1 £ 1R 


. VAAf 


1 % *m^J 


Most schools will have calculators 

for >ill cftiflmfc hv 1 QQO 


0 Q 


1.46 


mm > O 


1 OR 


i 6 


. UJ 


0.23 


.792 






1 A 






.46 


2.0 




7.67 


.001 


1,2>3 


Calculator use is causing students 
to lose the cliancc to do mental 
computations in school. 


2.3 


.90 


2.5 


1.06 


3.1 


.92 


2.98 


.062 




Calculators can stimulate a child 
to study mathematics. 


4.3 


1.05 


4.4 


.74 


3.6 


.63 


4.35 


.019 




Calculators do not allow students 
to do simple math on paper. 


2.3 


1.11 


2.5 


1.41 


3.1 


1.03 


1.51 


.233 




Calculators make mathematics fun. 


4.7 


.46 


4.7 


.62 


3.4 


.83 


19.90 


.000 


1 ,2>3 


TOTAL SCORE 


87.4 


4.72 


87.9 


4.68 


70.5 


6.64 


50.29 


.000 


1 .2>3 



Now. df for all items = 2, 42. 
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